Reward revaluation biases hippocampal replay content away from the preferred outcome
نویسندگان
چکیده
منابع مشابه
Offline Replay Supports Planning: fMRI Evidence from Reward Revaluation
Making decisions in sequentially structured tasks requires integrating distally acquired information. The extensive computational cost of such integration challenges planning methods that integrate online, at decision time. Furthermore, it remains unclear whether “offline” integration during replay supports planning, and if so which memories should be replayed. Inspired by machine learning, we ...
متن کاملReward Backpropagation Prioritized Experience Replay
Sample efficiency is an important topic in reinforcement learning. With limited data and experience, how can we converge to a good policy more quickly? In this paper, we propose a new experience replay method called Reward Backpropagation, which gives higher minibatch sampling priority to those (s, a, r, s′) with r 6= 0 and then propagate the priority backward to its previous transition once it...
متن کاملHippocampal Replay of Extended Experience
During pauses in exploration, ensembles of place cells in the rat hippocampus re-express firing sequences corresponding to recent spatial experience. Such "replay" co-occurs with ripple events: short-lasting (approximately 50-120 ms), high-frequency (approximately 200 Hz) oscillations that are associated with increased hippocampal-cortical communication. In previous studies, rats exploring smal...
متن کاملReverse Replay of Hippocampal Place Cells Is Uniquely Modulated by Changing Reward
Hippocampal replays are episodes of sequential place cell activity during sharp-wave ripple oscillations (SWRs). Conflicting hypotheses implicate awake replay in learning from reward and in memory retrieval for decision making. Further, awake replays can be forward, in the same order as experienced, or reverse, in the opposite order. However, while the presence or absence of reward has been rep...
متن کاملTask Demands Predict a Dynamic Switch in the Content of Awake Hippocampal Replay
Reactivation of hippocampal place cell sequences during behavioral immobility and rest has been linked with both memory consolidation and navigational planning. Yet it remains to be investigated whether these functions are temporally segregated, occurring during different behavioral states. During a self-paced spatial task, awake hippocampal replay occurring either immediately before movement t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Nature Neuroscience
سال: 2019
ISSN: 1097-6256,1546-1726
DOI: 10.1038/s41593-019-0464-6